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ABSTRACT 

Problem: In hospitals in rural, resource-limited 

settings, there is an acute need for simple, practical 

strategies to improve healthcare quality. 

Setting: A district hospital in remote western Nepal. 

Key measures for improvement: To provide 

a mechanism for systems-level reflection so that staff 

can identify targets for quality improvement in 

healthcare delivery. 

Strategies for change: To develop a morbidity and 
mortality conference (M&M) quality improvement 
initiative that aims to facilitate structured analysis of 
patient care and identify barriers to providing quality 
care, which can subsequently be improved. 
Design: The authors designed an M&M involving 
clinical and non-clinical staff in conducting root-cause 
analyses of healthcare delivery at their hospital. 
Weekly conferences focus on seven domains of causal 
analysis: operations, supply chain, equipment, 
personnel, outreach, societal, and structural. Each 
conference focuses on assessing the care provided, 
and identifying ways in which services can be 
improved in the future. 

Effects of change: Staff reception of the M&Ms was 
positive. In these M&Ms, staff identified problem areas 
in healthcare delivery and steps for improvement. 
Subsequently, changes were made in hospital 
workflow, supply procurement, and on-site training. 
Lessons learnt: While widely practiced throughout 
the world, M&Ms typically do not involve both clinical 
and non-clinical staff members and do not take 
a systems-level approach. The authors' experience 
suggests that the adapted M&M conference is 
a simple, feasible tool for quality improvement in 
resource-limited settings. Senior managerial 
commitment is crucial to ensure successful 
implementation of M&Ms, given the challenging 
logistics of implementing these programmes in 
resource-limited health facilities. 



THE PROBLEM 

Simple, effective tools are needed to improve 
quality in resource-limited health facilities 
(unpublished data, Maru et al. 2011). The 
morbidity and mortality conference (M&M) is 
a well established practice globally. ^ There is, 
however, limited experience with M&M as 
a hospital-wide quality improvement strategy 
in resource-limited settings. While clinical and 
process audits have been piloted for condi- 
tions such as maternal or perinatal disease,'' *^ 
to our knowledge there are no published 
reports of hospital-wide M&Ms in resource- 
limited settings. Furthermore, there is limited 
experience in utilising M&Ms to encourage 
better understanding of systems-level health- 
care issues, and to encourage transparent, 
non-punitive discussion among staff regarding 
areas for improvement. Some recent litera- 
ture* has highlighted the importance of 
these aspects of M&Ms, but they are not yet well 
implemented across resource-poor settings. 

Given that M&Ms are common throughout 
the world, a refocusing of the M&M as 
a systems-level quality improvement inter- 
vention could be feasible in many resource- 
limited settings. Here we present a qualitative 
observational study of the implementation of 
a hospital-wide M&M as a quality improve- 
ment initiative at a district hospital in remote 
western Nepal. 

METHODS 

Setting 

Achham is a remote district in western Nepal 
and is the third poorest district in one of the 
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world's poorest countries. It has a primarily agrarian 
(60%) population of 266000. Median annual household 
income is US$141 with literacy rates of 52% for men and 
14% for women. Chronic malnutrition rates for children 
under five are 63.5%/'^ and maternal mortality rates are 
231 per 100 000.^'' 

Bayalpata Hospital (BH) opened in 2009 and is one of 
only two hospitals in Achham. BH is run by the non- 
profit organisation Nyaya Health in partnership with the 
Nepali Ministry of Health and Population. In 2010, BH 
treated over 23 000 outpatients and inpatients. BH has 28 
Nepali staff, 23 (82%) of whom are from Achham or 
neighbouring districts. Thirteen (46%) are women, 
including two of the five (40%) senior hospital 
management positions. Literacy rates are 92% for female 
staff and 93% for male staff, with 46% of female staff and 
60% of male staff having post-secondary education. The 
clinical staff are overseen by the medical director (BG), 
who has received his medical bachelor's degree and has 
1 year of postgraduate work experience. The clinical 
team also includes one medical officer (a bachelor's level 
physician), two senior nurses (with bachelor's degree 
training), two mid-level practitioners (3 years training 
post-secondary school), and five midwives (18 months 
training post-secondary school). In addition to these full- 
time employees, there is one full-time Nepali Bayalpata 
Hospital volunteer director of community health (RS), 
and one full-time expatriate volunteer executive director 
(DS) . Both volunteers played a significant role in devel- 
oping and implementing the M&M. 

Strategy for change 

Prior to this programme, BH lacked a mechanism for 
systems-level reflection enabling staff to identify chal- 
lenges and areas for quality improvement in healthcare 
delivery. The authors hypothesised that a hospital-wide 
M&M would be a feasible quality improvement initiative 
aimed to facilitate structured analysis and improvement 
of patient care. Successful change was defined as the 
implementation of this M&M with staff-wide involvement 
and tangible changes seen in healthcare delivery at BH. 

IVI&IVI programme design 

In M&Ms, BH staff review recent clinical cases using root 
cause analysis of M&M, identifying systems failures and 
opportunities for future improvement. In order to 
address the inter-relatedness of quality challenges across 
both clinical and non-clinical departments, all hospital 
personnel are encouraged to participate in M&Ms. To 
facilitate broad participation, M&Ms are conducted 
during protected time at weekly staff meetings. Given the 
small staff size and limited clinical expertise at BH, 
external volunteer physicians offer further clinical input 
via email. Approximately 15 clinicians participate. 



including Nepali physicians in Nepal and abroad, Amer- 
ican physicians, and other colleagues of Nyaya Health. 

The M&M process begins with the weekly selection of 
a complicated clinical case by BH's medical director. 
Cases are selected with input from clinical staff, focusing 
on cases in which staff feel that the clinical management 
and/ or the non-clinical aspects of management can be 
improved. Due to the volume of cases seen at BH, not all 
cases can be reviewed, but as a policy, all mortalities are 
reviewed. After selecting the case, a case summary, 
including questions requiring guidance, is circulated to 
external volunteer physicians who offer feedback 
regarding clinical management prior to the M&M. 
Preparation for each week's M&M, including writing the 
case summary and communicating with external volun- 
teer physicians, typically involves at least 2—3 h of work 
on behalf of the medical director. BH's hospital admin- 
istrator and executive director are frequentiy involved in 
this preparation as well. 

M&Ms occur during weekly staff meetings, with 
a 30—60 min case discussion structured around seven 
domains of causal analysis relevant to the resource- 
limited setting in which BH operates. Staff discussion is 
supplemented by input received from external volunteer 
physicians. The seven discussion domains were derived 
from the classic Ishikawa method: ^'^ 

► Clinical operations — concerns with patient flow, intake, 
or processing in clinical departments, laboratory, 
radiology, or pharmaceutical operations. 

► Supply chains — challenges in obtaining reliable 
supplies of quality medicines or equipment. 

► Equipment — issues in the functioning, quality, or 
availability of equipment. 

► Personnel — factors pertaining to training, profession- 
alism, management, or collaboration. 

► Outreach — issues in recruiting patients into timely and 
appropriate care through community engagement. 

► Societal — challenges faced by gender, caste, economic, 
or other social status. 

► Structural — factors related to infrastructure, such as 
roads, telecommunications, educational or healthcare 
facilities. 

The medical director facilitates discussion and actively 
solicits contributions from all staff present. The M&M 
concludes with a review of lessons learnt and recom- 
mendations, and responsible personnel and timelines 
are identified for implementation of recommendations. 
Afterwards, a case summary is circulated to external 
volunteer physicians for review, and final transcripts are 
made publicly accessible.^'' 

After the M&M conference, the medical director, 
hospital administrator, and executive director oversee 
the implementation of proposed changes to clinical or 
non-clinical operations. These duties vary by case, and 
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due to their broad scope, can often take weeks or even 
months to fully implement. Other staff are often 
charged with these responsibilities, for example, the 
medical director oversees the midwives revising delivery 
protocols. All preparation and follow-up responsibilities 
are included in job descriptions; staff are not paid extra 
or provided separate time for these duties. 

Study methods 

We conducted a 9-month, qualitative observational study 
of the implementation of this M&M programme. We 
obtained ethical review for this study from both the 
Nepal Health Research Council and Boston Medical 
Center's Institutional Review Board (USA) . 

M&M discussions, quoting directly from staff members 
in real time, were transcribed and translated into English 
by one of the authors (RS). Throughout the study, 
formal programme reviews were conducted at 3-month 
intervals. These reviews were facilitated by the medical 
director and included all staff members. During these 
reviews, we elicited staff responses concerning M&M 
participation, impact of M&Ms on individual and 
collective work practices, impact of M&Ms on hospital 
policies, value of input by external volunteer physicians, 
and barriers to implementation of M&Ms. 

A grounded theory approach was used for analysis, in 
which two authors (DS, RS) reviewed transcripts and 
coded content. The coding revealed two primary cate- 
gories: the effect of M&Ms on staff and the effect of 
M&Ms on hospital operations. Further analysis of both 
categories demonstrated six primary themes within staff 
effects, and three primary themes within hospital oper- 
ations effects. These themed analyses are described 
qualitatively below. 

EFFECTS OF CHANGE 

Scope of IVI&IVI cases 

Cases encompassed a wide breadth of clinical condi- 
tions. Summaries of cases, the problems identified, and 
the recommendations made are presented in table 1, 
and an example case summary is given in box 1 . 

Participation and staff response 

Typically, 80—85% of on-duty personnel attended M&Ms. 
Overall, M&Ms were received positively by personnel, 
although the programme struggled with consistency and 
oversight. Staff members identified five key benefits to 
the M&M; here we present select staff comments, 
excerpted from programme reviews and individual M&M 
meeting notes: 

► More rigorous case analysis and identification of areas 
for improvement: Tt's been 2 years since the hospital 
opened but until now we have never been able to 
analyse and think in depth about how the critical 



cases are managed' (nurse); Tt is not just a review of 
a particular case, but a review of our hospital: what the 
problems are, what is missing, and what can be done 
to improve' (staff physician). 

► Improved collaboration and team-based learning: 
'Cases are only managed by a few personnel and are 
not well understood by the rest of the staff, so these 
M&Ms help us to learn from the lessons of the other 
staff in those cases' (laboratory assistant) ; 'Staff learn 
from each other, and when we think in retrospect 
critically about the cases... we learn the value of team 
efforts in regards to our shortcomings and how we 
can improve next time' (staff physician). 

► Better understanding of clinical operations among 
non-clinical staff: 'We non-clinical staff gain an 
improved background of what kind of cases we see 
at the hospital and how the clinical operations 
function... this also helps us to explain what services 
Bayalpata Hospital offers to various community 
members who ask us about their health problems' 
(data manager); 'These discussions have helped me 
to learn things that are directly relevant to my work 
here at Bayalpata Hospital... for example, the various 
drugs that we use and how to order the different 
doses, which previously I did not understand and led 
to mistakes in purchasing' (accountant). 

► Improved communication between junior and senior 
staff members: 'Clinical and administrative managers 
learn about the logistical problems of junior staff 
members that they might not know about otherwise' 
(medical director) . 

► External volunteer clinical consultations: 'With these 
outside physician volunteers, I am able to gain much 
information that was previously unknown to me about 
case management, and it is helpful to feel support 
from senior physicians even though we have such 
small staffing here' (staff physician). 

Cliallenges 

Despite these benefits, the programme has encountered 
challenges. Some non-clinical staff members have been 
frustrated by M&Ms: '... they are helpful in some ways, but I 
don't think that all non-clinical staff should always have to 
attend because sometimes it's not helpful' (data manager). 
Additionally, staff have noted that 'it is frustrating to keep 
discussing the same issues, but they are not yet resolved. We 
know some things take long times, but the management 
should be faster and more effective about addressing these 
problems' (nurse). The latter concern has been particu- 
larly relevant for issues of long-term improvement, such as 
development of community health worker networks and 
improvement of water or electrical facilities. 

The programme has also had difficulty with oversight 
and stciffing. During the course of the study period. 
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Table 1 Selected cases from Bayalpata Hospital's morbidity and mortality conference* 



Age, sex 



Primary 
diagnosis 



Problems identified 



Domains of Causai 
Analysis 



Recommendations 



20 years, 
woman 

I. 



6 years, boy, 
12 years, boy 



28 years, man 



L 



Intrauterine 

fetal 

demise 



Botulism 
poisoning 



Suicide 
attempt 



8 months, boy Pneumonia 




19 years, woman 



L 



Retained 
placenta 



35 years, woman 



I 



Motor vehicle 
accident 



87 years, man COPD 




Laboratory staffing is 
insufficient at times of high 
patient volume 



There is a lack of trained 
ultrasonographers at the 
hospital 

Clinicians are not in contact 
with private pharmacies and 
traditional healers in the 
villages 

There is a lack of mental 
health services in our 
catchment area 



Pharmacy lacks any type of 
anti-depressant medications. 

Oxygen tanks are unavailable 
locally, and pre-existing tanks 
cannot be refilled locally 

AMBU bags are not easily 
accessible in emergency 
situations 



Some mid-level practitioners 
and nurses are unfamiliar with 
basic resuscitation protocols 
Limited pharmacy staffing 
leads to problems at times of 
high patient volume 



ER ultrasounds are not being 
administered in a timely 
fashion 



Close observation of patients 
with COPD has been 
insufficient due to visibility 
from the nurses' station 

The pharmacy lacks any 
inhalers. 



Clinical operations. 
Personnel 



Clinical operations. 
Equipment, Personnel 

Clinical operations. 
Personnel, 
Outreach, Societal 



Clinical operations. 
Personnel, Structural 



Clinical operations. 
Supply chains 

Clinical operations. 

Equipment, 

Supply chains. 

Structural 

Clinical operations. 

Equipment, 

Personnel 



Clinical operations. 
Personnel 

Clinical operations. 
Personnel 



Clinical operations. 

Equipment, 

Personnel 



Clinical operations. 
Personnel 



Clinical operations. 
Supply chains 



I 



Additional training for nurses and 
mid-level practitioners should be 
conducted by lab personnel to 
enable lab task shifting during 
times of high patient volume 
Management should investigate 
options for off-site intensive 
training for a staff member 
Management should develop 
a list of contact information and 
meetings should be set up at the 
hospital and in the community for 
relationship building ^| 
Medical director and 
management should develop 
emergency referral list and crisis 
line with psychiatrists in the 
capital 1^ 
Management should procure at 
least two different medicines and 
identify long-term suppliers 
Management should procure 
tanks and oxygen from the 
capital for the ER, inpatient 
wards, and the ambulance 
Senior nurse should identify 
a designated location for bag 
valve masks in the ER and | 
inpatient wards, spaced in close 
proximity to all beds to avoid 
delays in administering care 
On-site protocol review should be 
conducted by the senior 
physicians 

The pharmacist should conduct 
task-shifting workshops for ^ 
medicine dispensing and 
stocking for nurses and mid-level 
practitioners 
ER ultrasound utilisation 
protocols should be developed by 
physicians to ensure that patients 
receive urgent scans when 
indicated 

Senior nurse should designate 
a specific bed in the ER for these 
patients with close observation 
and all necessary equipment in 
close proximity 

Management and the pharmacist 
should procure multiple types of 
inhalers for both inpatient and 
outpatient management of 
respiratory disease. 



Continued 
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Table 1 Continued 



Age, sex 



Primary 
diagnosis 



Problems identified 



Domains of Causal 
Analysis 



Recommendations 



60 years, man Tuberculosis 



I. 



17 years, man Head trauma 



I 



36 years, 
woman 



Antepartum 
liaemorrhage 




Tuberculosis diagnostic 
criteria are not being 
appropriately followed 

Staff attend off-site training 
but do not share their new 
knowledge and skills with 
other staff 

Patients in the ER wait for 
long periods of time even for 
simple items like intravenous 
fluids 

Partographs are being used 
inconsistently and improperly 



Patient family members 
receive low-quality and 
inconsistent counselling in 
the ER 



Clinical operations. 

Equipment, 

Personnel 

Clinical operations. 
Personnel 



Clinical operations. 

Equipment, 

Personnel 

Clinical operations. 

Equipment, 

Personnel 



Clinical operations. 
Personnel, Societal 



Clinicians and lab personnel 
should henceforth utilise both 
radiological and sputum-based 
diagnostic testing 
Management should institute 
post-training skill-sharing 
workshops for all staff members 
attending training 
The medical director and senior 
nurse should institute standing 
orders for ER patients 



Physicians and senior nurse 
should conduct partograph 
training, along with beginning 
a programme to monitor weekly 
partograph completion rates and 
the review of all completed 
partographs 

The medical director and 
management should identify 
a key person to provide 
counselling to ER patient family 
member 



I 



nd 

I 



*Many of these M&Ms had several recommendations but for the purpose of this paper, we have simply provided a selection from each case. 
COPD, chronic obstructive pulmonary disease; ER, emergency room. ^ 



despite the weekly programme design, M&Ms have only 
occurred in 19 of 35 weeks (54%). Of the missed weeks, 
eight occurred between December 2010 and January 
201 1 , a period during which the executive director was off 
site and other staff shortages were present coincidentally. 
Other M&Ms that were missed were often a result of need 
to stop or postpone the meeting to handle emergency 
care during the staff meeting time. 

Another challenge has been promoting active 
involvement of all staff. Despite efforts to create 'open 
dialogue', junior staff, who are often less well educated 
and/or from lower social castes, participate less than 
other staff. In M&M transcript reviews, an average of only 
8% of the comments were made by such staff members, 
despite them accounting for 46% of the staff. The same 
has been true with regards to gender dynamics, with 
women contributing an average of only 31% of the 
comments, despite accounting for 46% of the staff. 

Hospital operations 

In addition to benefits and challenges discussed by staff, 
M&Ms have also led to changes in hospital operations. 
Some examples of these changes are given below. 

Workflow modifications 

An M&M reviewing a complicated delivery highlighted 
the need for enhanced laboratory staffing during times 



of high patient volume (Domains of Causal Analysis: 
Clinical operations and Personnel). This resulted in 
laboratory personnel conducting task-shifting workshops 
for all clinical staff to conduct emergency, point-of-care 
investigations, such as blood chemistries, complete 
blood counts, HIV, and pregnancy tests. These sessions 
occurred 3 weeks after the M&M, and since have enabled 
task shifting during periods of high patient flow, 
resulting in improved laboratory capacity. 

On-site clinical training 

An M&M reviewing a complicated delivery found 
inconsistent and improper recording of partographs 
(Domains of Causal Analysis: Clinical operations. 
Equipment, and Personnel). On review of the previous 4 
weeks of deliveries, a baseline partograph completion 
rate of only 20% was noted. This led to a teaching 
session by physicians targeted at nurse midwives on the 
importance of partographs during the active stage of 
labour. Simultaneously, clinicians started a monitoring 
programme which involved evaluating the percentage of 
partographs completed per week and reviewing each 
completed partograph. In the subsequent 2 months, 
partograph completion rates increased to 76%, but not 
all forms were completed correctly. The programme 
remains in place, now focusing on correct utilisation of 
forms in addition to completion rates. 
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Box 1 Example of morbidity and mortality (M&M) 



Case selection 

An 8-montli-old boy presents witli severe pneumonia, 
proceeds througli a complicated hospital course, and dies 
of cardiopulmonary arrest. The medical director identifies 
the case as one with many lessons and opportunities for 
future improvement. Total work requirements: 30-min 
discussion among medicai staff. 

Case write-up 

The medical director emails the case summary to external 
volunteer clinicians for further input regarding the compli- 
cations in the hospital course. Total work requirements: 2 h 
by medical director. 

Team input 

External volunteer physicians send several emails discus- 
sing pathophysiology and resuscitation protocols. Total 
work requirements: email conversation including 1 1 emails 
in total from five external volunteer physicians, the Bayal- 
pata Hospital's executive director, medical director, and 
staff physician. 

Case conference 

During the weekly staff meeting the medical director facili- 
tates a discussion reviewing the case. Three staff members 
are unfamiliar with the management of pediatric sepsis and 
severe respiratory distress (Domain of Causal Analysis: 
Personnel). The nurses explain that the nebuliser was not 
functioning due to electrical outages and failure of the hospital 
generator (Domains of Causal Analysis: Equipment, Supply 
Chains, and Structural). The ambulance driver highlights the 
lack of sufficient bag valve masks, oxygen tanks, and regu- 
lators to share between all hospital departments (Domains of 
Causal Analysis: Clinical operations and Equipment). Total 
work requirements: 1 h M&M meeting including 16 staff 

Recommendations 

The staff and senior management agree that personnel 
training is needed to review pediatric sepsis and resusci- 
tation protocols. Additional oxygen tanks, regulators, and 
masks are needed for the ambulance, emergency room, 
and inpatient wards. Total work requirements: none (part of 
the case conference described above). 

IVI&IVI summary write-up 

The medical director summarises the content of the discus- 
sion, recommendations, and lessons learnt, and emails the 
write-up to all external volunteer physicians. This generates 
several further email exchanges regarding oxygen adminis- 
tration in pediatric resuscitation. Total work requirements: 
2 h by the Bayaipata hospital director of community health. 

Recommendation implementation 

Two weeks later, physicians conduct a review of clinical 
protocol and skills. The hospital administrator and procure- 
ment staff obtain new oxygen tanks, regulators, and masks 
from the capital city; however, due to supply chain difficulties, 
this procurement takes over 2 months. Total work require- 
ments: approximately 10 h over the course of 2 months. 



Pharmacy and medical equipment 

An M&M reviewing a suicide attempt documented lack 
of antidepressant and antipsychotic medicines in the BH 
pharmacy (Domains of Causal Analysis: Clinical opera- 
tions and Supply chains). After procuring several new 
medicines, that same patient was placed on outpatient 
fluoxetine therapy. Six months later, he remains in 
follow-up and has improved substantially. 

DISCUSSION 
Lessons learnt 

Our experience suggests that a modified systems- 
oriented M&M programme such as the one described is 
a simple, feasible strategy for quality improvement in 
resource-limited settings. At our hospital in rural Nepal, 
despite challenges with implementation, our staff were 
able to identify problem areas and steps for improve- 
ment in healthcare delivery. In implementing this 
programme we have identified four key lessons. 

Involve both clinical and non-clinical staff 

The majority of M&Ms worldwide are conducted as 
conferences primarily for senior-level clinicians.^ Our 
experience suggests the involvement of both clinical and 
non-clinical staff will help to identify broader systems- 
level issues to impact patient care. 

Structure discussions with a systems-level perspective 

M&Ms typically focus on medical aspects of cases. Here, we 
utilised a seven-domain root-cause analysis to better iden- 
tify systems-level issues and areas for quality improvement. 
As discussed in other recent literature,^ this approach 
helps remove blame from individuals and instead focus on 
systems, thereby creating a culture of learning more 
focused on quality improvement. 

Foster senior managerial commitment 

Managerial oversight is integral to the success of such 
a programme. Specifically, oversight is needed to ensure 
conferences occur consistently, time is allocated in work 
schedules to facilitate M&M attendance, all staff are 
encouraged to participate, and finally that recommen- 
dations are pursued after conferences. 

Use M&Ms to guide resource utilisation 

The M&M has helped BH staff better target hmited 
resources to critical problem areas (eg, emergency room 
equipment, staff training). In many settings like ours, 
demands outstrip resources. M&Ms offer a mechanism 
to prioritise competing demands using input from first- 
hand staff experience. 

Limitations 

Limitations to our study include implementation of 
a small, qualitative study at a single site with external 
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volunteer support. While external support has added the 
benefit of expert medical input and education, several 
M&Ms were conducted successfully with no external 
volunteer input. In our reviews, we found that almost all 
recommendations resulting in changes to clinical or 
management protocols came from staff discussions, 
illustrating the value of the programme even in the 
absence of external support. 

The study is also limited as two lead investigators — the 
executive director (DS) and medical director (BG) — are 
the two most senior members of staff, thereby intro- 
ducing potential bias into the process of eliciting critical 
feedback from staff about the programme and its 
implementation. 

Next steps 

At BH, we endeavour to soon fund a full-time quality 
improvement staff member, part of whose responsibili- 
ties will include overseeing the consistent and effective 
implementation of M&Ms and follow through on all 
identified problems and recommendations. Addition- 
ally, we aim to provide on-site training for our mid-level 
clinical providers and midwives regarding general quality 
improvement principles, which will help to fully realise 
the potential of M&Ms and further develop broad quality 
improvement initiatives at BH. 

Both at BH and elsewhere, future research should 
investigate quantifiable quality outcomes to assess the 
patient- and operations-level impact of such 
programmes. This could involve measuring the impact 
on a suite of plan-do-study-act-driven interventions, as 
has been done in other studies. Additionally, 
programmes should develop metrics to measure staff 
engagement in the process of quality improvement. 

Conclusion 

We have described an adapted systems-oriented M&M as 
a feasible quality improvement tool for resource-limited 
settings. The M&M programme at BH has helped iden- 
tify and catalyse quality improvement initiatives for 
healthcare provided in our rural facility. 
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